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SLEEPINESS DETECTION FOR 
VEHICLE DRIVER OR MACHINE 
OPERATOR 

PRELIMINARY AMENDMENT 

Assistant Commissioner for Patents 

Washington, D.C. 20231 

Sir: 

Prior to the first Official Action and calculation 
of the filing fee, please replace Claims 1-11 as originally filed, 
which appear on pages 16 and 17, with Claims 1-10 as filed in the 
Article 34 amendment of 30 November 1998. The replacement pages 
containing Claims 1-10 are marked "AMENDED SHEET" and are attached 
hereto. Following the insertion of Claims 1-10, please amend these 
claims as follows: 

IN THE CLAIMS : 

Claim 3, line 2, change "either of the preceding 
claims" to --claim 1--. 

Claim 4, line 2, change "any of the preceding 
claims" to --claim 1--. 

Claim 5, line 2, change "any of the preceding 
claims" to --claim 1--. 

Claim 6, line 2, change "any of the preceding 
claims" to --claim 1--. 
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Claim 7, line 2, change "any of the preceding 
claims" to --claim 1--. 

Claim 8, line 2, change "any of the preceding 
claims" to --claim 1--. 

Cancel claim 9. 

Claim 10, line 3, change "any of the preceding 
claims" to --claim 1--. 

REMARKS 
The above changes in the claims merely place this 
national phase application in the same condition as it was during 
Chapter II of the international phase, with the multiple dependen- 
cies being removed. Following entry of this amendment by substitu- 
tion of the pages, only claims 1-8 and 10 remain pending in this 
application . 

Respectfully submitted, 
YOUNG Sc THOMPSON 
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Sleepiness Detection for Vehicle Driver or Machine Operator 



This invention relates to human sleepiness, drowsiness or (lack of) alertness detection 
and monitoring, to provide a warning indication in relation to the capacity or fitness to 
drive or operate (moving) machinery. 

Although its rationale is not fully understood, it is generally agreed that sleep is a 
powerfui and vital* biological need, which - if ignored - can be more incapacitating 
than realised, either by a sleepy individual subject, or by those tasking the subject- 
As such, the invention is particularly, but not exclusively, concerned with the 
(automated) recognition of sleepiness and performance-impaired fatigue in drivers of 
motor vehicles upon the public highway. 

Professional drivers of, say, long-haul freight lorries or public transport coaches are 
especially vulnerable to fatigue, loss of attention and driving impairment 

With this mind, their working and active driving hours are already carefully monitored 
to ensure they are within prescribed limits. 

Road accidents, some with no apparent external cause, have been attributed to driver 
fatigue. 

Studies ► including those by the Applicants themselves, (seethe appended references) , 
into sleep-related vehicle accidents have concluded that such accidents are largely 
dependent on the time of day. 

Age may also be a factor - with young adults more likely to have accidents in the early 
morning, whereas older adults may be more vulnerable in the early afternoon. 

Drivers may not recollect having fallen asleep, but may be aware of a precursory 
sleepy state, as normal sleep does not occur spontaneously without warning. 

The present invention addresses sleepiness monitoring, to engender awareness of a 
state of sleepiness, in turn to prompt safe countermeasures, such as stopping driving 
and having a nap. 

Accidents have also been found to be most frequent on monotonous roads, such as 
motorways and other main roads. 

Indeed, as many as 20-25% of motorway accidents seem to be as a result of drivers 
falling asleep at the wheel. 

Although certain studies concluded that it is almost impossible to fall asleep while 
driving without any warning whatsoever, drivers frequently persevere with their driving 
when they are sleepy and should stop. 
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Various driver monitoring devices, such as eyelid movement detectors, have been 
proposed to assess fatigue, but the underlying principles are not well-founded or 
properly understood. 

Sleepiness in the context of driving is problematic, because the behavioural and 
psychological processes which accompany falling asleep at the wheel may not typify 
the characteristics of sleep onset commonly reported under test conditions and 
simulations by sleep laboratories. 

Driving will tend to make a driver put considerable effort into remaining awake, arid in 
doing so, the driver will exhibit different durations and sequences of psychological and 
behavioural events that precede sleep onset. 

As underlying sleepiness may be masked by this prefacing compensatory effort, the 
criteria for determining whether a subject is falling asleep may be unclear. 

Indeed, the Applicants have determined by practical investigation that parameters 
usually accepted to indicate falling asleep are actually not reliable as an index of 
sleepiness if the subject is driving. 

For example, although in general eye blink rate has a tendency to rise with increasing 
sleepiness, this rate of change is confounded by the demand, variety and so stimulus 
content or level of a task undertaken (eg driving), there being a negative correlation 
between blink rate and task difficulty. 

In an attempt to prevent sleep-related vehicle accidents, it is also known passively to 
monitor driver working times through chronological activity logs, such as tachographs. 
However, these provide no active warning indication. 

More generally, it is also known to monitor a whole range of machine and human 
factors for vehicle engineering development purposes, some merely for historic data 
accumulation, and other unsatisfactory attempts at Veal-time 1 active warning. 

The Applicants are not aware of any practical implementation hitherto of sleepiness 
detection, using relevant and proven biological factors addressing inherent body 
condition and capacity. 

Studies and trials carried out by the Applicants have shown that there are clear 
discernible peaks of sleep-related vehicle accidents in the UK around 02,00-06.00 
hours and 14.00-16,00 hours. 

Similar time-of-day data for such accidents have been reported for the USA, Israel 
and Finland. 

These sleep-related vehicle accident peaks are distinct from the peak times for all road 
traffic accidents in the UK - which are around the main commuting times of 08.00 
hours and 17.00 hours. 
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The term 'sleepiness' is used herein to embrace essentially pre-sleep conditions, 
rather than sleep detection Itself, since, once allowed to fall asleep, it may be too late 
to provide useful accident avoidance warning indication or correction. 

Generally, a condition or state of sleepiness dictates 

5 • a lessened awareness of surroundings and events; 

• a reduced capacity to react appropriately; and 

• an extended reaction time. 

It is known from sleep research studies that the normal human body biological or 
physiological activity varies with the time of day, over a 24 hour, (night-day-night) 
1 0 cycle - in a characteristic regular pattern, identified as the circadian rhythm, biorhythm 

or body clock. 

The human body thus has a certain pre-dtsposition to drowsiness or sleep at certain 
periods during the day - especially in early morning hours and mid-afternoon. 

This is exacerbated by metabolic factors, in particular consumption of alcohol, rather 
15 than necessarily food per se. 

According to one aspect of the invention, 

a monitor taking account of circadian and sleep parameters 

of an individual vehicle driver, 

and/or generic or universal human physiological factors, 
20 applicable to a whole class or category of drivers, 

is integrated with 'real-time' behavioural sensing, 
such as of road condition and driver control action, 
including steering and acceleration, 
to provide an (audio-) visual indication of sleepiness. 

25 For safety and legislative reasons, it is not envisaged that, at least in the immediate 

future, an alert condition would necessarily be allowed automatically to over-ride driver 
control - say by progressively disabling or disengaging the vehicle accelerator. 

Rather, it would remain a driver's responsibility to respond constructively to an alert 
issued by the system - which could log the issue of such warnings for future reference 
30 in assessing compliance. 

Overall system capability could embrace recognition any or all of such factors as: 

common, if not universal, underlying patterns of sleepiness (pre-conditioning); 

exacerbating personal factors for a particular user-driver, such as recent sleep 
patterns especially, recent sleep deprivation and/or disruption; 

35 with a weighting according to other factors, such as the current time of day. 



3 



30/06 '99 WEB 15:10 FAX 01926 419636 TILLBROOK & IPS 121007 

! 

* WO PCT/GB9S/00015 



Thus background circumstances* in particular a natural alertness low point' - and 
attendant sleepiness or susceptibility to (unprompted) sleep - in the natural 
physiological biorhythmic or circadian cycle may pre-dispose a driver to sleepiness, 
exacerbated by sleep deprivation in a recent normal sleep period. 

5 If not circadian rhythm patterns themselves, at least the ability of the body behaviour 

and activity to respond to the underlying pre-disposition or pre-condition, may be 
disturbed or frustrated by abnormal or changing shift patterns, prefaced by inadequate 
acclimatisation. 

Thus, for example, in exercising vehicle control, aberrant driver steering behaviour, 
1 0 associated with degrees of driver sleepiness, could be recognised and corrected * or 

at least a warning issued of the need for correction (by sleep restitution). 

Pragmatically, any sleepiness warning Indication should b© of a kind and in sufficient 
time to trigger corrective action. 

According to another aspect of the invention, 
15 a driver sleepiness, 

alertness or fitness condition monitor 
comprises 

a plurality of sensory inputs, 

variously and respectively related to, 
20 vehicle motion and steering direction, 

circadian or biorhythmic physiological patterns, 

recent driver experiences 

and pre-conditioning; 

such inputs being individually weighted, 
25 according to contributory importance, 

and combined in a computational decision algorithm or model. 

to provide a warning Indication of sleepiness. 

Some embodiments of the invention can take Into account actual, or real-time, vehicle 
driving actions, such as use of steering and accelerator, and integrate them with 
30 inherent biological factors and current personal data, for exampl e recent sleep pattern, 

age, sex, recent alcohol consumption (within the legal limit), reliant upon input by a 
driver being monitored. 

Steering action or performance is best assessed when driving along a relatively straight 
road, such as a trunk, arteriaf road or motorway, when steering inputs of an alert driver 
35 are characterised by frequent minor correction. 

In this regard, certain roads have characteristics, such as prolonged 'straightness 1 and 
monotonous contouring or landscaping, which are known to engender or accentuate 
driver sleepiness. 

it is envisaged that embodiments of the steering detector would also be able to 
40 recognise when a vehicle is on such (typically strarghter) roads. 
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Some means, either automatically through a steering sensor, or even from manual 
input by the driver, is desirable to recognised motorway as opposed to, say, town 
driving conditions, where large steering movements obscure steering irregularities or 
inconsistencies. 

5 indeed, the very act of frequent steering tends to contribute to, or stimulate, 

wakefulness. Yet a counter/ailing tendency to inconsistent or erratic steering input may 
prevail, which when recognised can signal an underlying sleepiness tendency. 

In practice, having recognised the onset of journeys on roads with an enhanced 
sleepiness risk factor, journey times on such roads beyond a prescribed threshold - 
10 say 10 minutes - could trigger a steering action detection mode, with a comparative 

test against a steering characteristic algorithm, to detect sleepy-type driving, and issue 
a warning indication in good time for corrective action. 

As another vehicle control condition indicator, accelerator action, such as steadiness 
of depression, is differently assessed for cars than lorries, because of the different 
15 spring return action. 

implementation of semi-automated controls, such as cruise-controls, with constant 
speed setting capabilities, could be disabled temporarily for sleepiness monitoring. 

in assessing driver responses to pre-programmed device interrogation reliance is 
necessarily placed upon the good intentions, frankness and honesty of the individual. 

20 A practical device would embody a visual and/or auditory display to relay warning 

messages and instructions to and responses from the user. 

Similarly, interfaces for vehicle condition sensors, such as those monitoring steering 
and accelerator use, could be incorporated. 

Furthermore, input (push-button) switches for driver responses could also feature - 
25 conveniently adjacent to the visual display. 

input effort would be minimal to encourage participation, and questions would be 
straightforward and direct, to encourage explicit answers. 

Visual display reinforcement messages could be combined with the auditory output. 

Ancillary factors, such as driver age and sex, could also be input. 

30 An interface with a global positioning receiver and map database could also be 

envisaged, so that the sleepiness indicator could register automatically roads with 
particular characteristics, including a poor accident record, and adjust the monitoring 
criteria and output warning display accordingly. 

The device could be, say, dashboard or steering wheel mounted, for accessibility and 
35 readability to the driver. 
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Ambient external light conditions could be sensed by a photocell. Attention could thus 
be paid at night to road lighting conditions- 
Vehicle driving cab temperature could have a profound effect upon sleepiness, and 
again could be monitored by a localised transducer at the driver station. 

5 The device could categorise sleepiness to an arbitrary scale. Thus, for example, the 

following condition levels could be allocated: 

• Alert 

• a uttle sleepy 

• Noticeably sleepy 

10 • Difficulty in staying awake 

• Fighting sleep 

• Wj LL FALL ASLEEP 

Personal questions could include: 

• Quantity of sleep im the last 24 hours 

15 • quauty op that sleep in the last 24 hours 

Road conditions could include: 

• Motorway 

• Monotonous 

• Town 

20 Night-time with no street lights could be given a blanket impairment rating or loading. 

Assumptions are initially made of no alcohol consumption whatsoever (ie legal limits 
disregarded). 

A circadian rhythm model allows a likelihood of falling asleep, or a sleep propensity, 
categorised between levels 1 and 4 - where 4 represents very likely and 1 represents 
25 unlikely. 

The lowest likelihood of sleepiness occurs from mid morning to early afternoon. 

Thereafter a mid afternoon lull, or rise in likelihood of sleepiness to 3 is followed by 
another trough of 1 in early evening, rising stepwise towards late night, through 
midnight and into the early hours of the morning. 

30 There now follows a description of some particular embodiments of the invention, by 

way of example only, with reference to the accompanying diagrammatic and schematic 
drawings, in which: 

Figure 1 shows the circuit layout of principal elements in a sleepiness monitor for a 
road vehicle driver; 
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Figure 2 show an Installation variant for the indicator and control unit of the sleepiness 
monitor shown in Figure 1; 

Figure 3 shows a graphical plot of varying susceptibility to sleepiness over a 24 hour 
period, reflecting human body circadian rhythm patterns; 

5 Figures 4 and 5, 6 and 7> 8 and 9 show paired personal performance graphs, reflecting 

steering wheel inputs for three individual drivers, each pair representing comparative 
alert and sleepy (simulated) driving conditions; 

Figure 10 shows principal elements of a driver monitor system, with an integrated 
multi-mode sensing module; 

10 Figure 11 shows a sensing arrangement for motion and steering, in relation to 

respective reference or datum axes, for the multi-mode sensing module of Figures 10 
and 12; 

Figure 12 shows a the multi-mode sensor of Figure 10 in more detail; 

Figures 13A through 13D show a variant housing for the multi-mode sensor of Figures 
15 10 and 12; 

Figures 14A and 14B show steering wheel dynamic sensing geometry; 

Figures 15A through 15D show steering wheel movement and attendant correction; 

Figures 16A and 16B show vehicle acceleration and correction; 

Figure 17 shows periodic variation of sleepiness/alertness and attendant warning 
20 threshold levels; 

Figure 18 shows the sub-division of system operational time cycles; 

Figure 1 9 shows system data storage or accumulation for computation; 

Figures 20/2,2 through 20/5.5 variously represent system data and computational 
factors and attendant software flow charts for implementing the device of Figures 1 
25 through 19; and 

Figure 21 shows a circuit diagram of a particular multi-mode sensor, with a magnetic- 
inductive flux coupling sensing of rate of change of steering wheel movement. 

Referring to the drawings, a sleepiness monrtor 10 is integrated within a housing 1 1 , 
configured for ease of in-vehicle installation, for example as a dashboard mounting, 
30 or, as depicted in Figure 2 f mounted upon a steering wheel 12 itself. 

In a preferred variant, the monitor 10 would be self-contained, with an internal battery 
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power supply and all the necessary sensors fitted internally, to allow the device to be 
personal to a driver and moved with tho driver from one vehicle to another. 

An interface 19, for example a multi-way proprietary plug-and-socket connector, is 
provided in the housing, to allow interconnection with an additional external vehicle 
5 battery power supply and various sensors monitoring certain vehicle conditions and 

attendant driver control action. 

Thus a steering wheel movement sensor 1 3 monitors steering inputs from a driver (not 
shown) to steering wheel 12. 

The sensor 13 could be located within the steering wheel 12 and column assemtaly. 

10 More sophisticated integrated multi-channel, remote sensing is described later in 

relation to Figures 11 and 12. 

Similarly, an accelerator movement sensor 15 monitors driver inputs to an accelerator 
pedal 14. 

Alternatively, and again in a more sophisticated sensor variant, a dynamic 
15 accelerometer could be employed, as in Figures 1 1 and 12, 

The sensor 15 could be an accelerometer located within the housing 11 in a self- 
contained variant. Care is taken to obviate the adverse effects of vehicle vibration upon 
dynamic sensory measurements. 

Albeit, somewhat less conveniently, vehicle motion and acceleration could be 
20 recognised through a transmission drive shaft sensor 27, coupled to a vehicle road 

wheel 26 or by interfacing with existing sensors or control processors for other 
purposes, such as engine and transmission management. 

The trend to multiplex vehicle electrical supply systems, relaying data between vehicle 
operational modules, may facilitate such interconnection. 

25 More sophisticated sensors, with an ability for remote self-contained condition sensing, 

data accumulation and data transfer, data down-loading or data up-loading may be 
employed. 

Thus, for example, a steering wheel movement sensor module, a the version of Figure 
21 , may rely upon a wireless or contact-free linkage - such as magnetic flux coupling 
30 between magnetic elements on the wheel or shaft and an adjacent static inductive or 

capacitative transducer to register rate of change of wheel movement (as opposed to. 
say an average RMS computation of Figures 15A and 15B). 

Such remote sensing and data linkage obviates the need for major vehicle wiring 
harness alternation or supplement. 

35 Overall, the device could have an internal memory of speed and steering wheel 



8 



0/06 '99 WED 15:12 FAX 01926 419636 TILLBROOK & IPS 11,012 
WO 98/29S47 PCT/GB98/00015 



movements and so the basis of a 'performance history 1 of driver actions as a basis for 
decision upon issuing warning indication. 

The interface 19 would enable data to be down-loaded onto a PC via, say, the PC 
parallel port or over a radio or infra-red 'wireless' link. 

5 A further photocell sensor 29 monitors ambient light conditions from the driving position 

and is calibrated to assess both day-night transitions and the presence or absence of 
street lighting at night 

in the variants of Figures 1Q, 12 and 13A through 13D, multi-mode or multiple 
(independent) factor sensing is integrated within a common so-called 'steering wheel 
1 0 adaptor* module 33, 

Reverting to the unit 10 of Figures 1 and 2, the housing 11 incorporates a visual 
display panel or screen 18, for relaying instructions and warning indications to the user. 

A touch-sensitive inter-actronaf screen could be deployed. 

Manuaf or automated adjustment for screen contrast according to ambient light 
15 conditions could be embodied. 

The variants of Figures 10, 12 and 13A through 13D allow for a simpler devolved 
display of certain operating criteria* by multiple LED's on a multi-mode sensor module 
33. 

A loudspeaker 21 can relay reinforcement sound messages, for an integrated audio- 
20 visual driver interaction. 

Also to that end, in a more sophisticated variant - possibly merely as an ongoing 
research and developmenttool, a microphone 23 might be used to record and interpret 
driver responses, possibly using speech recognition software. 

Alternatively, interactive driver interrogation and response can be implemented a series 
25 of push button switches 1 6 arrayed alongside the screen 1 8, for the input of individual 

driver responses to preliminary questions displayed upon the screen 1 B. 

Thus, for example, non-contentious factors, such as driver age and sex may be 
accounted for, together with more subjective review of recent sleep history. 

Questions would be phrased concisely and unequivocally, for ease and immediacy of 
30 comprehension and certainty or authenticity of response. 

Thus, for example, on the pivotal contributory factor of driver's recent sleep, the 
question: 

'How much sleep hav& you had in the iast 24 hours' 
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could bs juxtaposed with a multiple choice on screen answer menu, such as: 
Chojce of ONE answer ... 

Little or none ... [generating a weighting score of 2] 
Less than normal ... [score 1] 
5 about the same as normal, undisturbed ... [score o] 

About the same as normal, but disturbed ... [score 1] 

Other contributory factors include road conditions and vehicle cabin temperature. 

Road conditions would be assessed through the steering sensor 13, and through an 
initial input question upon road conditions. 

10 Thus, a dull, monotonous road would justify a weighting of plus 1 to all the circadian 

scores. 

On the other hand, town driving, promoting greater alertness from external stimuli, 
would merit a score of minus 1 . 

Vehicle cabin temperature is taken into account, primarily to register excessively high 
1 5 temperatures which might induce sleepiness. 

Driver cab temperatures could be monitored with a temperature sensor probe 31 
(located away from any heater output vents). 

Thus, for example, a threshold of some 25 degrees C might be set, with temperatures 
in excess of this level triggering a score of plus 0.5. 

20 In normal operating mode, the monitor relies upon the working assumption that the 

driver has had little or no recent or material alcohol consumption. 

The physiological circadian rhythm 'template' or reference model pre-loaded into the 
monitor memory is adjusted with the weighting scores indicated. 

If the cumulative score is equal to or greater than 3, the steering sensor is actively 
25 engaged and checked to determine the road conditions. 

The sleepiness scale values, reflected in the unweighted graph of Figure 3 T can 
broadly be categorised as: 

• Alert 

• Neither alert nor sleepy 
30 • A little sleepy 

• Noticeably sleepy 

« Difficulty in staying awake 

• Fighting sleep 

• Will fall asleep 
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An internal memory module may store data from the various remote sensors 13, 15, 
27, 29, 31 - together with models or algorithms of human body circadian rhythms and 
weighting factors to be applied to individual sensory inputs. 

An internal microprocessor is programmed to perform calculations according to driver 
5 and sensory inputs and to provide an appropriate (audio-)visual warning indication of 

sleepiness through the display screen 18. 

Figure 2 shows a steering-wheel mounted variant, in which the housing 11 sits 
between lower radial spokes 17 on the underside of steering wheel 12 - in a prominent 
viewing position for the driver, but not obstructing the existing instrumentation, in 
10 particular speedometer, nor any air bag fitted- 

Ambient temperature and lighting could also be assessed from this steering wheel 
vantage point. 

This location also facilitates registering of steering wheel movement. With an internal 
accelerometer and battery, external connections couid be obviated. 

1 5 Whilst a motor vehicle orientated monitor has been disclosed in the foregoing example, 

the operating principles are more widely applicable to moving machine-operator 
environments, as diverse as cranes, construction site excavators and drilling rigs - 
possibly subject to further research and development. 

Figures 4 through 9 show the respective steering 'performances* of three individual 
20 subjects, designated by references Si , S2 and S3, under alert and sleepy (simulated) 

driving conditions. 

Each graph comprises two associated plots, representing steering wheel movement in 
different ways. 

Thus, one plot directly expresses deviations of steering wheel position from a straight- 
25 ahead reference position - allotted a 'zero' value. 

This plot depicts the number of times a steering wheel is turned in either direction, over 
a given time period - allowing for a +/- 3% 'wobble' factor as a 'dead 1 or neutral band 
about the reference positron. 

The other plot is an averaged value of steering wheel movement amplitude (ie the 
30 extent of movement from the reference position) - using the RMS (root mean squared) 

of the actual movements. 

Generally, the graphs reflect a characteristic steering performance or behaviour. 

In particular, as a person becomes sleepy, zero crossings are reduced in frequency, 
whereas RMS amplitudes increase and/or become more variable. 

35 Thus, Figure 4 reflects steering behaviour of an alert subject S1 . 
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Collectively, the 'zero-crossing 1 and •RMS' plots for atari subject S1 reflect a generally 
continual and consistent steering correction. 

In contrast, the steering behaviour of a sleepy subject S1 , reflected in Figure 5, exhibits 
less frequent, erratic, exaggerated or excessive steering movement. 

5 Figure 6 reflects steering behaviour for another alert subject S2, whilst Figure 7 shows 

the corresponding readings when the same subject was sleepy. 

Figure 8 reflects steering behaviour of yet another alert subject S3 and Figure 9 that 
of that subject S3 when sleepy. 

Each pair of graphs shows corresponding marked differences in steering behaviour 
10 between an alert and sleepy driver. 

This characteristic difference validates the use of actual or real-time dynamic steering 
behaviour to monitor driver sleepiness. 

In a practical system, using steering wheel movement to identify sleepiness, on the 
basis of such findings, it is preferred that, before presenting a sleepiness warning 
1 5 indication, at least two of the following three sleep categorising conditions of steering 

behaviour are present namely: 

• Fewer zero crossings; 

• rms amplitude high; 

• RMS MORE VARIABLE. 

20 RMS averaging may be superceded by other sensing techniques, such as that of the 

magnetic flux-coupled, inductive sensor of Figure 21 , which can register more directly 
rate of change of steering wheel movement. 

Turning to refinement of practical implementation, Figure 10 shows a block schematic 
overall circuit layout or principal elements. 

25 More specifically, the various sensing modes - including vehicle motion (linear 

acceleration), steering wheel angle, ambient light, temperature, are combined with an 
audio sounder and mark button in an integrated so-called 'steering wheel adaptor 1 
module 33. 



The sensor module 33 is connected through a cable way to an electronic interface 32, 
30 which in turn is configured for connection to a personal computer parallel port 39 

through a cable link and a mains charger unit 37. 

The orientation of the sensor module 33 in relation to reference axes for acceleration 
and steering wheel angular position are represented in Figures 11 and 12. 

Angular sensing could be, say> through a variable magnetic flux coupling between 
35 magnets set on the steering wheel or column and on adjacent static mounts. 
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Figures 13A through 13D show a master sensor unit 33 with a simplified LED warning 
indicator array. The detailed circuitry Is shown in Figure 21 . 

Essentially, the steering sensor measures a change in inductance through an array of 
some three inductors Li, L2 and L3 through magnetic flux coupling changes caused 
5 by movement in relation to the magnetic field of a small magnet 'M* static-mounted 

upon the steering column - at a convenient, unobtrusive location, 

The inductors L1 , L2 and L3 are energised by a 32kHz square wave generated by a 
local processor clock. 

Induced voltage is rectified, smoothed, sampled and measured by the local processor 
10 some 16 times per second. 

The processor analyses the results digitally to determine the extent of steering wheel 
movement. 

Calibration of the minimum and maximum voltages across each inductor as the 
magnetic field of the static magnet sweeps across them when the steering wheel is 
15 fully turned is undertaken by the local processor, so the mounting location of the static 

magnet is not overly critical. 

Such inductive sensing is unaffected by road vibration, since both static magnet and 
inductors are subject to the same vibration and any effect cancelled out 

The local processor feeds sensor data to an executive processor loaded with 
20 sleepiness detector algorithms, base upon such factors as circadian rhythm of 

sleepiness, timing and duration of sleep and ambient light, and which presents an 
overall indication of driver sleepiness level. 

The arrangement is capable of registering and measuring very small angular 
movements, such as might be encountered in corrective steering action at speed. 

25 Figures 14A through 15D relate to wheel movement sensing by a more indirect 

computational technique, involving RMS averging, compared with the direct rate of 
change capability of magnetic flux-coupled inductive sensing of the Figure 21 circuitry. 

Figures 1 4A and 1 4B represent dynamic steering wheel movement sensing. 

Figures 1 5 A and 1 5B represent respectively Yaw 1 and adjusted wheel movements over 
30 time. 

Figure 1 5C represents a 'zero crossings 1 count, derived from the adjusted plot of Figure 
15B. 

Figure 15D depicts the 'dead band 1 range of wheel movement allowed. 

Figures 16A and 16B respectively, represent 'raw 1 and corrected plots of vehicle 
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acceleration over time - allowing computation of an RMS average acceleration. 

Figure 17 depicts a characteristic circadian sleepiness rhythm or pattern, with a three- 
tiered sleepiness warning threshold levels. 

Figure 18 represents a breakdown of system activity over (T = 60 second) operational 
5 clock cycles - with a division between monitoring the various sensors over 50 seconds 

and 10 seconds process time allocation for parameter calculation, test and warning 
issue, display screen update, sensor data storage and storage of calculated 
parameters. 

Frgure 19 represents data storage array allocation, for monitoring and learning of 
10 factors such as vehicle acceleration and wheel movement. 

Hardware considerations aside, an operational software protocol would involve a 
schema of factors, such as represented in the listings Figures 20/2.1 through 20/5.5, 
which are generally self-explanatory and will not otherwise be discussed. 



Component List 

Q 





15 


10 


(sleepiness) monitor 






11 


housing 






12 


steering wheel 






13 


steering position/movement sensor 






14 


accelerator pedal 




20 


15 


accelerator position/movement sensor 






16 


push-button switch 






17 


steering wheel spokes 






18 


display panel/screen 






19 


interface connector 




25 


21 


loudspeaker 






23 


microphone 






26 


road wheel 






27 


(drive) shaft sensor 






29 


photocell sensor 




30 


31 


temperature probe 






33 


multi-mode sensor 






32 


electronic interface 






37 


mains charger 






39 


parallel data port 



35 Literature References 

• J. Sleep Research 1994 vol 3 p!95; Accidents & Sleepiness 1 : consensus of 
Stockholm International Conference on work hours, sleepiness and accidents. 
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1. 



A sleepiness monitor (10) 

for a vehicle driver or machine operator, 

comprising a sensor (13), 

for registering a vehicle or machine condition factor, 

and attendant control action, 

an input for personal condition history, 

a memory, for storing 

a physiological reference model, 

of circadian rhythm pattern, 

and an operating model or algorithm, 

for determining driver condition or vehicle action, 

and computational means, 

for weighting the operating model 

according to registered condition, history or action, 

and providing a warning indication (18) 

of driver or operator sleepiness. L 



2- 

A sleepiness monitor, 

as claimed in Claim 1 , 

including a sensor, 

for vehicle steering wheel movement, 

and attendant directional control. 



3. 

A sleepiness monitor, 

as claimed in either of the preceding claims, 

including means for registering steering wheel movement, 

about a reference position, 

the computational means determining 

the character of the route being driven 

and the steering behaviour in relation to that route, 

allowing account to be taken 

of the frequency and amplitude of correction , 

about a straight-ahead steering position. 



4, 

A sleepiness monitor, 

as claimed In any of the preceding claims, 

including a sensor for vehicle acceleration and/or speed. 
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A sleepiness monitor, 

as claimed in any of the preceding claims, 

including a temperature sensor, 

for a driver or operator environment. 



6. 

A sleepiness monitor, 

as claimed in any of the preceding claims, 

including a sensor for ambient light conditions. 



7. 

A sleepiness monitor, 

as claimed in any of the preceding claims, 

including provision for driver or operator input, 

of personal condition factors, 

taken into account by the computational means, 

in weighting the operating model or algorithm, 

and adjusting a threshold of warning indication accordingly. 



3 _ A sleepiness monitor. 

Q as claimed in any of the preceding claims, 

03 including provision for driver or operator input, 

fy of personal condition factors, 

jS including recent sleep history 

|I and/or alcohol consumption, 

'2 taken into account 

W by the computational means, 

in weighting the operating model or algorithm, 

and adjusting a threshold of warning indication accordingly. 



9. 

A sleepiness monitor, 
substantially as hereinbefore described 
with reference to,and as shown in, 
the accompanying drawings. 



10. 

A vehicle or machine, 

incorporating a sleepiness monitor, 

as claimed in any of the preceding claims. 
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Figure 1 
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Figure 3 
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Figure 5 
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Table 1 



Acc # 1-Vehicle Motion 
Acc # 2-Wheel Angfe 
Light Sensor - Ambient 
Temp Sensor - Ambient 
Sounder 
Mark Button 



37 



39 



D25 

ADC Converter 
Pico ADC 11 



Charger 
240VAC 



PC Parallel Port 
Figure 10 



Ace#2 
True Sensor 
Axis 




Detect Steering 
Angle 



✓ ' Acc# 1 

True Sensor Axis 



Figure 11 
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Rear panel 
Figure 13D 



Side view 




Top View 
Figure 13C 



29 Running LED Warning LED 's 
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Figure 13B 



Figure 13A 
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Table 2 



W - Wheel Rotation Angle 

X - Measured component of g in sensor axis (rn/s/s) 
K wheel - Sensor seating factor (mm/s/s/blt) 
g - Gravity 9.61 m/s/s 

g - Gravity Vector Component in wheel Plane 



Sin W = X / g 

X = k wheel / 1000 x{Ch(i).ZeroVvheel ) x 1/Cos(Alpha) 
Sin W = k wheel / (1000 x g)x(Ch(1)-ZeroWheel)x(l /Cos (Alpha) 

W + ArcSin [ Kwheel /(1 000 x g)x(Ch(i)-ZeroWheel)x l/Cos(Alpha)] 




w / 

/ 

/ Figure 14A 
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Figure 15A 



Engmeerino Corrected wh*.„ii«i/rw.\ 
Steering deviation angle WhwWhKDog) 





W Limit- 



Zero X Counl-Z (« / min) 

Figure 15C 
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Tables 



- ZsroWheel (b\i) 



Steering =' Active' 



Siaedng = 'Correciivo' 



< 



S Bering ='Aetwe' 



T Monhor 











RMS Sigenna Angle- R(Deg) * 


n 




Table 4 




Bound Check 

W Limit- <W<W Limit+ 
W< W Limit- 
W > W Limit* 



Steering Mode=Corrective 
Steering Mode=Active 
Steering Mode=Active 



/ W(Deg) \ 
W Umit+ W Limit - 



Figure 15D 
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n (min) 



n+i(min) 



— T cycle (s)- 



-T monitor (s)- 



Monitor Sensors @ 1 Hz 



-T process (a)^ 



Table 6 



T cycle = 60s 
T monitor = 50s 
T process = 10s 



Figure 16 



Calculate Parameters 

Test & Issue Warnings 

Update Screen Display 

Store Sensor Data > Disk 

Store Calculated Parameters > Disk 
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Figure 19 



RawAcc(n] 



Acc[n] 



Tmonitor 



TIearn 
300 



RawWheei[n] Wheelln] 



Table 7 



Note; 

Data storage @ iHz 
ZeroAcc=Average {RawAcc[n]} 
ZeroWheeJ -Ave rage {RawWheel[nJ} 
Ch(N)=Raw ADC Value (bit) 



Table 8 



Acc[n] s Kacc/1000 x (Raw Acc[n]-ZeroAcc)x1/Cos( Alpha) 
(m/s/s) (mm/s/s/brt) (bit) (bit) 

Whe©l[n] * ArcSin [ Kwhee!/(1 000x9.81) x (RawWheel[n]-2eroWheel)x1/Cos(Alpba)] 
(Peg) (mm/ste/bit) (bit) (bit) 

i * Kllght/1000 x (Ch(2)-ZeroUght) 
(KLx) (Lx/blt) (bit) (bit) 

T = Ktemp/1 000 x (Ch(3) - ZeroTemp) 
(DegC) (mDegC/bit) (bit) (bit) 
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Figure 21 
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Table 1 



Acc # 1 -Vehicle Motion 
Acc#2-Wheel Angle 
Light Sensor - Ambient 
Temp Sensor - Ambient 
Sounder 
Mark Button 



Table 2 



W - Wheel Rotation Angle 

X - Measured component of g In sensor axis (m/s/s) 
K wheel * Sensor scaling factor (mnVs/s/bit) 
g - Gravity 9.81 m/s/s 

g - Gravity Vector Component cn wheel Plane 



Stn W = X/g 

X = k wheel / 1000 x (Ch(t)-ZeroWheei ) x i/Cos{Aipha) 

Sin W s k wheel / (1000 x g)x(Ch(l )-2eroWheel)x(1/Cos( Alpha) 



W + ArcSin [ Kwheel /(1 000 x g)x(Ch(l )-ZeroWheel)x 1/Cos(Alpha)J 



Table 3 




s 



Table 4 



Bound Check 



W Limits < W< W Limit+ 
W < W Limit- 
W > w Limit* 



Steering Mode=Corrective 
Steering Mode=Active 
Steering Mode=Active 
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Table 5 




Table 6 



T cycle = 60s 
T monitor s= 50s 
T process = 10s 



Calculate Parameters 
Test & Issue Warnings 
Update Screen Display 



Store Sensor Data > Disk 
Store Calculated Parameters > Disk 



Table 7 
Note: 

Datastorage @ 1Hz 
ZeroAcc-Average {RawAccfn]} 
Zerovvheel=Average {RawWheelfnl 
Ch(N)^Raw ADC Value (bit) 



Table 8 

Acc[n] = Kacc/tOOO x (RawAcc[nJ-ZeroAcc)xi/Cos(Alpha) 
(m/s/s) (mm/s/s/bit) (bit) (bit) 

Wheel[n] = ArcSin f KwheeJ/( 1000x9.81) x (RawWheel[n}-ZeroWheel)xl/Cos(Alpha)] 
(Deg) (mm/s/sA)it) (bit) (brt) 

I a Klight/1000x (Ch(2)-ZeroUght) 
(KLx) (bc/bit) (bit) (brt) 

T ±» Kiemp/1000 x (Ch(3) - ZeroTemp) 
(DegC) (mDegC/blt) (bit) (bit) 
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Tabid 9 



Engineering Scaling Factors 




K acc (mm/s/s/bit) 


Acceleration Channel 


K wheel (mm/s/s/blt) 


Steering Channel 


K light (Lx/bit) 


Light Channel 


K temp (mDegC/bit) 


Temp Channel 


ZeroLlght (bit) 


Intercept adjust - Light 


ZeroTemp (bit) 


intercept adjust - Temp 


Alpha (Deg) 


Steering Wheel Inclination from Vertical 


Hysterlsis (Peg) 


Hesterisls factor - Zero X analysis 
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Table io 



Sleep Propensity Algorithm - Definition 




S mod=S circ + S zero* ■+ S rms + S light + S temp + S steep + S road + S trip 


Elemental 


Bound Limit 


S mod 


0<S mod <1 


S circ 


0<S circ <:1 


S zerox ^ (F zerox/1 00) (2 ref-Z) 


0<S aerox 


S rms = (F rms/1 00) (R-R ref) 


0<S rms 


S light = (F light/100) (I r©f -I) 


0<S light 


S temp * (F ternp/100) (T -T ref) 


0<S temp 


S sleep = (F sleep/100) (H ref - (HxQ)) 


0<S sleep 


S road = (F road/100) (G ref -G) 


0<S road 


Strip = (FtrIp/i00)xD 


0<S trip 



Table n 



Algorithm Elementafs - S 

S mod (S) Modified Sleep Propensity Factor-Range 0...1 

S circ (S) Current Circadian Sleep Propensity Value 

S zerox (S) Current Corrective Steering Reversal Rate Deficit 

S rms (S) Current RMS Corrective Steering Amplitude Surf it 

S fight (S) Current Ambient Ughting Intensity Deficit 

S temp (S) Current Ambient Temperature SurfU 

S sleep (S) Prior Sleep Good Hours Deficit 

S road (S) Current Road Activity Deficit 

S trip (S) Accumulated Trip Duration 
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Table 12 





Algorithm Weighting Factors - F 




Note : Factors are % S Unit per Parameter Unit 




Fzerox (%S/#/min) 


Corrective Steering Reversal Rate Deficit - % Factor 




F rms (%S/Deg) 


RMS Corrective Steering Amplitude Surflt - % Factor 




F light (7©S/kl_x) 


Average Ambient Lighting Iniensfty Deficit - % Factor 




F temp (%S/DegC) 


Average Ambient Temperature SurfJi - % Factor 




F sleep (%S/Hr) 


Prior to Good Hours Sleep Deficit - % Factor 




F road (%S/m/s/s) 


Road Activity Deficit - % Factor 




F trip (%S/Hr) 


Accumulated Trip Duration - % Factor 




Table 13 






Algorithm Reference Offfsets - ref 




Z ref (#/min) 


Corrective Steering Reversal Rate - Ref Offset 






Corresponds to "Alert 1 Driving Subject Dependent 


SET.?.' 


R ref (Deg) 


Corrective Steering RMS Amplitude - Ref Offset 






Corresponds to Alert * Driving Subject Dependent 




I ref (kLx) 


Average Ambient Lighting Intensity - Ref Offset 






Corresponds to moderate daylight 




T ref (DegC) 


Average Ambient Temperature - Ref Offset 






Corresponds to moderate environment 




H ref (Hr) 


Prior to Good Hours Sleep - Ref Offset 






Corresponds to optimum value 




G ref (m/s/s) 


Road Activity - RMS Acceleration / Deceleration - Ref Offset 
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Table 14 



Algorithm Dynamic Variables 


Z (#/min) 


Current Corrective Steering Zero X Rate 


R (Deg) 


Current RMS Correvtive Steering Amplitude 


I (kLx) 


Current Ambient Lighting Intensity 


T(DegC) 


Current Ambient Temperature 


G (m/s/s) 


Current Road Activity - RMS Acceleration / Deceleration 


D(Hr) 


Accumulated Trip Duration 


H(Hr) 


Actual Hours of Prior Sleep 


Q(« 


Prior Sleep Quality - Normalised Scale 0...1 


Qx(#) 


Prior Sleep Quality 




User Scale 1 r 2.3>4>5 




Q=Qx/5 


TabJe 15 


Steering Mode & Steering Limit -W limit 


W limit <Deg) 


Decision limit - Steering mode detection 




+W limit >W> -W limit >» Corrective 




+W limit <W< -W limit >» Active 


Steering Mode 


Steering mode decision 




ACTIVE. CORRECTIVE 



Table 16 



Alarm Levels & Alarm State 


Alarm Level 1 ($) 


Alarm level threshold 


Alarm Level 2 (s) 


Alarm lever threshold 


Alarm Level 3 (s) 


Alarm level threshold 


Alarm Holdoff (min) 


Initial atarm forced hold-off time - N minutes 


Alarm State 


Alarm status decision 




CLEAR, LEVEL1, LEVEL2, LEVEL3. HOLDOFF 
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Table 17 



User Software Functions 
Set Display Parameters 

Enter New Values and <RET> or <RET> to bypass edit option. 

Display History (mln) Graphic display history length - Last N minutes 

FSD (S) Graphic display full scale - S unit {0,. i ) 



Table IB 

Data Directory Structure 

[ALGO] *.ALG 

Algorithm Data FNes - Internal Format 
[USER]\ALG 

User Data Files - Internal Format 
[XALGO]\CSV 

Algorithm Data Files - CSV Formal 

(XUSERJVCSV 

User Data Files - CSV Format 

[XDRIVE]\CSV 

Drive Mode Data Files - CSV Format 
IXLEARN]\C$V 

Learn Mode Data Files - CSV Format 
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Table 19 





File Structure - Program Internal Format 




Note : These files in program Internal readable format 




Configuration File 


- SLEEPALT.CFG 




Save Set Values 


@ Program Shut Down 




Load Set Value € 


) Program Initialisation 




K acc <mm/s/s/bli) 




K wheel (mm/s/s/bit) 




K light (Lx/bit) 






K temp (mDegC/bit) 




K batt (mWblt) 






ZcroUght 


(bit) 


o 


ZeroTomp 


{bit) 


.. '„ 


Hysterysis 


(Deg) 




Alpha 


(Deg) 




Algorithmic 






UserlD 






Circ[0] ... [23] 


(S) 




FSD 


(0-1) 




DfsplayHlst 


(min) 
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Table 20 

Algorithm Data File [AJ_GO]\ALG 

Fzerox (%S/#/min) 
F rms (%S/Deg) 
F light (%S/Klx) 
Ftemp (%s/DegC) 



F sleep 


(%S/Hr) 


F road 


(%S/m/s/s) 


Firip 


(%s/Hf) 


Zref 


(#/min) 


R ref 


(Deg) 


fret 


(KU) 


Tref 


(DegC) 


Hrof 


(Hr) 


G ref 


(m/s/s) 


Alarm 1 




Alarm2 


<s) 


Alarms 


(s) 



AlarmHoldoff (min) 
I W Ifmit (Peg) 

Table 21 

User Data File [USER]MJSR 

UserNam© 

UserDoB 

UserSex 
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Table 22 



Data File Structure - Drive Mode Data Pile [XDRIVE]\CSV 

Note; These files in external readable format - CSV 

Drive ID 

File Ceailon Date 
Start Time (Hr 0„ 23) 
Start Time (min 0.. 59) 
UseriD 
Algorithmic 

Alarml (s) 
Alarms (s) 
Alarm3 (s) 
AlarmHoidOff (mrn) 

W Mmit <Deg) 

H (Hr) 
Q(0.. 1> 

Fzerox (%S/#/min) 
F rms (%S/Deg) 
F tight (%S/kLx) 
F temp (%S/DegC) 
F sleep (%S/Hr) 
F road (%S/m/s/s) 
Ftrip (%S/Hr) 



Z ref 
ft ref 
I ref 
Tref 
H ref 
Gref 



(#/min) 

(Oeg) 

(Kix) 

(DegC) 

(Hr) 

(m/s/s) 



Minute Count (mtn) 

AlarmState 
SteeringMode 
Acceleration [l](m/s/s) 

Acceleration [501 



. Repeat 1 „ N(min) 



WheelflJ(Deg) 
Wheel[50] 



Z 
R 
I 

T 
G 
D 



(#/min) 

(Deg) 

(KLx) 

(DegC) 

(m/s/s) 

(Hr) 



S mod (S) 
S clrc (S) 
Szerox (S) 
S rms (S) 
S temp (S) 
S sleep (S) 
S road (S) 
S trip (S) 

DQC (Data Quality Code 0„255) 



SUBSTITUTE SHEET (RULE 2S) 



30/06 99 WED 15:24 FAX 01926 419636 TILLBROOK & IPS 
W0 9S/29847 , . 

29/30 

Table 23 

Data File Structure - Learn Mode Data Fife [XLEARN)*»CSV 

Note ; These* flies in external readable format - CSV 

Data File Structure - User Data File [XUSERJ\CSV 

Note : These files in external readable format ~ CSV 
UserfD 

File Creation Date 

UserNsme 

UserDoB 

UserSex 
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Table 24 



Data File Structure - Algorithm Data File [XALGO]\CSV 

Note : Triese files In external readable format - CSV 

AfgorithmID 

File Creation Date 

Fzerox (%S/#/min) 
P rms (%S/Deg) 
F light (%S/kU) 
Ftemp (%S/DegC) 
F sleep (%S/Hr) 
F road (%S/m/s/s) 
F trip <%S/Hr) 



Zref 
R ref 
I ref 
Tref 
Href 
G ref 



(#/min) 

(Deg) 

(KLx) 

(DegC) 

(Hr) 

(m/s/s) 



Alarmi <s) 
Aiarm2 (s) 
Alarm3 (s) 

AlarmHoldOff (min) 

W limit (Deg) 
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SLEEPINESS DETECTION FOR VEHICLE DRIVER OR MACHINE OPERATOR 

the specification of which: (check one) 
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